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REAL PARTY IN INTEREST 



The real party in interest is the assignee Intel Corporation. 
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RELATED APPEALS AND INTERFERENCES 
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III. STATUS OF THE CLAIMS 
Claims 1-30 are pending in the application. Claims 1-5, 9-12, 15-20, 22, and 25-30 are 
rejected. Each rejection is appealed. Claims 6-8, 13-14, 21, 23 and 24 are objected to and 
remain pending in the application. 
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IV. STATUS OF AMENDMENTS 
No amendments are presently pending in the application. Claims 1-5, 9-12, 15-20, 22 
and 25-30 are the subject of this appeal. 

V. SUMMARY OF THE INVENTION 

In accordance with one embodiment of the invention, noisy edges in video frames may be 
removed to achieve higher frame rates and better quality video. The noisy edge removal 
mechanism may be used with applications which employ digital video encoding of captured 
content. Examples include video conferencing, video phone, network streaming video, and 
others. By detecting the presence of noisy edges in a video frame, a noisy line may be removed 
and replaced by a clean neighboring line prior to encoding. Noise may be removed from the top 
edge, either side edge, or the bottom edge of the video frame 10 as needed. 

Turning to Figure 1, a noisy edge removal mechanism 20 may filter noise from a video 
frame 10 prior to entering a video encoder 18. In one embodiment of the invention, the noisy 
edge removal mechanism 20 includes a noisy edge detector 14 and a noisy edge filter 16. 
Initially, the noisy edge detector 14 receives a frame 10. The frame 10 is one of a plurality of 
frames 10 which make up a stream of video. The noisy edge removal mechanism 20 may be 
invoked for each frame 10 of the video stream, one at a time. For each frame 10, the noisy edge 
detector 14 analyzes one or more edges of the video frame 10. In one embodiment of the 
invention, an edge of the video frame 10 is selected, then divided into four equally sized 
portions. In Figure 2a, the top edge of the video frame 10 is divided into portions 20a, 21a, 22a, 
and 23a. These portions may be rows of the video frame 10, for example. See Specification, 
pages 2-3. 



2 



In Figure 2b, the left edge of the video frame 10 is divided into portions 20b, 21b, 22b, 
and 23b. These portions may be columns of the video frame 10, for example. In Figure 2c, the 
bottom edge of the video frame 10 is divided into portions 20c, 21c, 22c, and 23c. In Figure 2d, 
the right edge of the video frame is divided into portions 20d, 21d, 22d, and 23d. Once the edge 
of the video frame 10 is divided into portions of equal size, the portions are then subdivided into 
units of equal size. In Figure 3, a part of the video frame 10 of Figure 2a is subdivided into a 
plurality of units 24. 

Each unit 24 of the video frame 10 is associated with a value. For example, a video 
display may be subdivided into pixels. Each pixel commonly has a value associated with the 
pixel, which may be stored in video memory. Each unit 24 of Figure 3 may likewise be 
associated with a distinct value. 

In one embodiment of the invention, the noisy edge detector 14 determines the presence 
of noise based, in part, on comparisons between the values of the units 24 of the video frame 10. 
If adjacent units 24 are not similar, for example, noise may sometimes be inferred. So, once the 
video frame 10 is divided into discrete units 24, each one of which is assigned a value, 
mathematical operations may be performed to analyze the video frame 10. 

Comparisons between values of the units 24 may be made using mathematical operations. 
In one embodiment, the values of the units 24 in one portion are compared to the values of the 
units 24 in a second, adjacent portion. The results of these comparisons are added together, to 
arrive at a result which is representative of the relationship between the two portions. A second 
pair of portions is likewise analyzed, supplying a second result, and so on. These results are then 
compared, and analyzed against one or more threshold values. In one embodiment of the 
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invention, the threshold values may be adaptable to the type of noise or other criteria. See 
Specification, p. 4-5. 

In Figure 4, an analysis of the video frame 10, according to one embodiment of the 
invention, commences with the selection of an edge of the video frame (top, right, left, or 
bottom), subdivision of the video frame 10 into portions of equal size, and further subdivision in 
to units 24 (block 70). Once the edge of the video frame 10 has been subdivided into units 24, a 
pair of threshold values, Tl and T2, may be calculated (block 72). The threshold values are used 
to determine whether a value associated with one portiori 20, 21, 22 or 23 of the video frame 10 
varies significantly from a value associated with a second portion 20, 21, 22, or 23 of the video 
frame 10. 

In one embodiment of the invention, these threshold values are based upon two variables, 

9 

a and p. The values for a and p may be determined by analyzing one or more video frames 10 
in which noise is known to be present. The values for a and p may also be based upon the 
source of the noise. For example, noise which results from the improper handling of closed 
captioning signals may produce a certain, predictable type of noise, to which a particular a value 
may be assigned. Alternatively, certain types of video capture devices may produce noise along 
the edges of the video frame, and thus a particular a or p variable may be appropriate. The a 
variable is presumed larger than the p variable, so that both a "stronger" (or larger) threshold 
value and a "weaker" (or smaller) threshold value may b f e used to analyze the edge of the video 
frame 10. 

In one embodiment of the invention, once the a and p variables are known, Tl and T2 
may be calculated based upon the following formulas: 

Ti = (# units/portion) x a 
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T 2 = (# units/portion) x P 
where a > (3. Because a > p, the threshold value Tl is greater than the threshold value 

T2. See Specification, p. 5-6. 

Looking back at Figure 4, a comparison of units 24 along an edge of the video frame 10 
is performed (block 74). The comparison may be performed in a number of ways. In one 
embodiment of the invention, all units 24 of one portion are subtracted from all units 24 of an 
adjacent portion, to arrive at a plurality of results, the absolute values of which are then added 
together. This is called the sum of absolute differences, or SAD. In one embodiment, SAD 
values provide a discrete measure for analysis of the portions 20 through 23 of the video frame 
10, not just the units 24 contained therein. 

Turning back to Figure 4, once the SAD values for the portions 20 through 23 are 
determined, these values may be analyzed as well (block 76). In one embodiment of the 
invention, the "adjacent" SAD values are subtracted from one another, to arrive at one or more 
difference values, Dn. In one embodiment of the invention, once the difference values, D] and 
D 2 , are calculated, they may then be analyzed against the threshold values, T| and T 2 . 

In accordance with one embodiment of the present invention, the analysis includes four 
comparisons between the values, Di, D 2 , Ti, and T 2 , as shown in Figure 5. In one comparison, if 
D 2 is greater than T\, because Ti is the larger threshold value, noise is presumed to be found 
(diamond 82). Accordingly, two outermost portions, portion 20 and portion 21 of the video 
frame 10 are replaced with a third portion, portion 22, which is closer in from the edge of the 
video frame 10 (block 90). 

Next, D 2 is compared to T 2 (diamond 84). If D 2 is larger than T 2 , then D 2 is in between 
the two threshold values, Ti and T 2 . If, D 2 is between the two threshold values, and noise was 
found in the previous frame (as denoted by NOISEFOUND being TRUE), noise is presumed to 



be found (diamond 84). The two outermost portions, portion 20 and portion 21, of the video 
frame 10 are replaced with a third portion, portion 22, which is closer in from the edge of the 
video frame 10 (block 90). See Specification, pp. 6-8. 

In certain embodiments, calculations may identify noise by observing the spatial 
correlation between the portions 20 through 23 along the edge of the video frame 10. In other 
words, how similar portions 20 through 23 are to one another help to identify noise in the video 
frame 10. In addition to the calculations, noise detection in the previous frame may be included 
in analyzing the current frame. Once the noisy edge detector 14 has completed the analysis, the 
noisy edge filter 16 may replace one or more portions of the video frame 10 with a clean 
neighboring portion, in one embodiment of the invention. A new video frame 1 1 may then enter 
the video encoder 18. 

A software program, for implementing one embodiment of the invention, shown in 
Figure 6, begins by clearing the Boolean variable, NOISEFOUND (block 102). NOISEFOUND 
indicates whether the previous frame required noise removal. An integer variable, FRAME, is 
also cleared to zero. FRAME keeps track of the current frame. FRAME is incremented (block 
104). See Specification, p. 10. 

For the current video frame received, the sum of absolute differences for the first four 
portions 20 through 23 of the video frame 10 is calculated (block 106). These calculations result 
in three values, SAD2021, SAD2122, and SAD2223. Although four portions of the video frame 10 
are analyzed in the example, this number may be adjusted to a larger or smaller number, as 
desired. 

From the SAD values, two difference values, Di, and D 2 , are calculated. D\ is the 
absolute value of the difference between SAD2021 and SAD212.7. Likewise, the second difference 
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value, D 2 , represents the difference between SAD2122 and SAD 2223 . The threshold values, Ti and 
T 2 , are calculated (block 110). Once the calculations Di, D 2 , Ti, and T 2 are completed, analysis 
of the video frame 10 for noise may begin. 

In one embodiment of the invention, a series of queries determines whether the difference 
values Dj and D 2 exceed the threshold values Ti and T 2 (diamond 112). If the second difference 
value, D 2 , is greater than the first threshold value, T t , then noise has been detected. Accordingly, 
portions one and two of the video frame 10 are replaced with portion three (block 120). Further, 
the variable NOISEFOUND is set to TRUE (block 122), indicating that noise was found on the 
current frame. During analysis of subsequent frames, the variable NOISEFOUND is again 
tested. Next, if the second difference value, D 2 , exceeds the second threshold value, T 2 , and the 
variable NOISEFOUND is TRUE, then noise has again been detected (diamond 114). Again, 
portions one and two are replaced with portions three of the video frame 10 (block 120). 

Where the first two calculations fail to result in noise detection, a second pair of inquiries 
may be initiated. The first difference value, D|, is compared to the first threshold value, T) 
(diamond 116). If Di is larger, noise has been detected. In contrast to the result in block 120, 
however, only portion one is replaced with portion two (block 124). Otherwise, Di may be 
compared with the second threshold value, T 2 . If D] is greater than T 2 and the variable 
NOISEFOUND is TRUE, then noise is detected (diamond 118). Again, portion one is replaced 
with portion two (block 124). The variable NOISEFOUND is set to TRUE (block 122). 
Otherwise, the variable NOISEFOUND is set to FALSE (block 126). 

Following updates of the variable NOISEFOUND (block 122 and 126), the noisy edge 
removal mechanism 20 inquires whether the last frame has been reached (diamond 128). If so, 
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the operation is complete (block 130). Otherwise, the variable FRAME is incremented and the 
process is repeated (block 104). See Specification, pp. 10-12. 

In Figure 7, in accordance with one embodiment of the invention, a processor-based 
system 70 may include a processor 30. The noisy edge removal mechanism 20 may be stored on 
the hard disk drive 44 such that, upon receiving the video input signal 62, the noisy edge removal 
program 20 is loaded into the memory 34 and executed. The video encoder 18, also stored on 
the hard disk drive 44 in one embodiment of the invention, may be used to encode the resulting 
frames. See Specification, pp. 12-13. 

VI. ISSUES 

A. Are Claims 1-5, 9, 15-20, and 22 Patentable Under 35 U.S.C. § 102(e) Over 
Acharya? 

B. Are Claims 10 and 11-12 Patentable Under 35 U.S.C. § 102(e) Over Acharya? 

C. Are Claims 25, 26 and 30 Patentable Under 35 U.S.C. § 102(e) Over Acharya? 

D. Is Claim 27 Patentable Under 35 U.S.C. §1 02(e) Over Acharya? 

E. Are Claim 28 and 29 Patentable Under 35 U.S.C. §102(e) over Acharya? 

VII. GROUPING OF THE CLAIMS 
For purposes of this appeal, Applicant has grouped together claims 1-5, 9, 15-20, and 22; 
claims 10-12; claims 25, 26 and 30; claim 27; and claims 28 and 29, as set forth above. 

VIII. ARGUMENT 

A. Claims 1-5, 9, 15-20, and 22 Are Patentable Under 35 U.S.C. § 102(e) Over Acharya 
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Claim 1 recites a method including receiving a video frame; identifying noise in a first 
portion of the video frame; and replacing the first portion with a second portion of the video 
frame. Claims 1-5, 9, 15-20 and 22 stand rejected under 35 U.S.C. § 102(e) over U.S. Patent No. 
6,229,578 ("Acharya"). This rejection is improper. Nowhere does Acharya disclose (at least) 
"replacing the first portion with a second portion of the video frame" as recited by claim 1. 

In an Advisory Action the Examiner incorrectly contends that Acharya discloses this 
element in col. 9, Ins. 55-58 where Acharya states that "[alternatively, it may be desirable to use 
the dark current or reference pixels (of which there are usually several rows and columns) to 
substitute for missing values for edge pixels." Acharya, col. 9, Ins. 55-58; Advisory Action 
dated January 13, 2003, page 2. 1 This portion of Acharya relates to the use of reference pixels 
for purposes of averaging with other pixels for obtaining an average pixel value (i.e., multi-level 
median hybrid filtering or a linear averaging). See Acharya, col. 9, Ins. 1-61. Nowhere does this 
or any other portion of Acharya disclose replacing a first portion of a video frame with a second 
portion of a video frame as recited by claim 1. Thus, for at least this reason, claim 1 and claims 
2-5 depending therefrom are patentable. Similarly claim 9 and claim 15 depending therefrom, 
and claim 16 and claims 17-20 and 22 depending therefrom are also patentable. 

Claim 1 is also patentable for the further independent reason that Acharya does not 
disclose a method in which "identifying noise in a first portion of the video frame" occurs, as 
recited by claim 1 . In this regard, Acharya merely determines whether a pixel is an edge pixel or 
a non-edge pixel, and does not identify noise in a first portion of the video frame. In the 
Advisory Action, the Examiner contends (for the first time) that because Acharya discloses that 

1 It is telling that the Examiner recited this portion of Acharya for the very first time in the Advisory Action. Until 
then, the Examiner erroneously contended that replacement of a pixel by an average of neighboring pixels met the 
claimed "replacing the first portion with a second portion of the video frame." See Final Office Action dated 
October 22, 2002, p.2. 
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it is difficult to distinguish between noisy pixels and edge or detail pixels, Acharya meets this 
element. Advisory Action, p. 2. However, Acharya does not distinguish between noise and 
edges; it merely determines whether a pixel is an edge pixel or a non-edge pixel. Ejj,, Acharya, 
col. 5, Ins. 11-18; col. 15, Ins. 26-29. Thus the Examiner is incorrect in equating an edge pixel 
with noise. See Advisory Action, p. 2. Thus, for this further reason, claim 1 and claims 2-5 
depending therefrom are patentable. Similarly claim 9 and claim 15 depending therefrom, and 
claim 16 and claims 17-20 and 22 depending therefrom are also patentable. 

B. Claims 10 and 11-12 Are Patentable Under 35 U.S.C. § 102(e) Over Acharya 

Claim 10 depends from claim 9, and further recites that a software program that replaces 

a first portion of a video frame with a second portion of a video frame also writes to a memory to 
replace the first portion of the video frame. Claim 10 was also rejected under § 102(e) over 
Acharya. This rejection is improper. 

As discussed above regarding claim 1 ( see VIII. A), nowhere does Acharya disclose 
replacing a first portion of a video frame with a second portion of a video frame. More so, 
nowhere does Acharya disclose a "software program [that] writes to the memory to replace the 
first portion of the video frame." Instead, Acharya discloses that a resulting average value (i.e., 
not a second portion of the video frame) is stored into an array or table "so that the original value 
x (i\ j) is not overwritten...." Acharya, col. 12, Ins. 60*64. Accordingly, nowhere does Acharya 
disclose writing to memory to replace a first portion of a video frame. Instead, Acharya 
discloses the opposite. Thus for this further reason, claim 10 and claims 11-12 depending 
therefrom are patentable over Acharya. 

C Claims 25, 26 and 30 Are Patentable Under 35 U.S.C. § 102(e) Over Acharya 



10 



Claim 25 recites a method including receiving a video frame; analyzing a first portion of 
the video frame with a first adjacent portion of the video frame to obtain a first result; analyzing 
a second portion of the video frame with a second adjacent portion of the video frame to obtain a 
second result; and replacing the first portion of the video frame with one of the second portion, 
the first adjacent portion or the second adjacent portion if a comparison between the first result 
and the second result is indicative of noise. 

Claims 25, 26 and 30 were also rejected under § 102(e) over Acharya. This rejection is 
improper. Nowhere does Acharya disclose "replacing the first portion of the video frame with 
one of the second portion, the first adjacent portion or the second adjacent portion if a 
comparison between the first result and the second result is indicative of noise" as recited by 
claim 25. The Examiner contends that replacing a pixel under consideration with a linear 
average of the pixel and neighboring pixels as disclosed by Acharya meets this element. See 
Final Office Action, pp. 7-8. However, such an averaged pixel is not an original portion of a 
video frame. As such, the averaging technique of Acharya does not replace a first portion of a 
video frame with one of a second portion, a first adjacent portion, or a second adjacent portion, 
as recited by claim 25. Thus, claim 25 and dependent claims 26 and 30 are patentable over 
Acharya. 

D. Claim 27 is Patentable Under 35 U.S.C. §1 02(e) Over Acharya 

Claim 27 depends from claim 26 and further recites calculating a first threshold based 

upon an amount of plurality of units per the respective portion of the video frame. Claim 27 also 
stands rejected under § 102(e) over Acharya. 

Dependent claim 27 is patentable for the further reason that nowhere does Acharya 
disclose "calculating a first threshold based on an amount of the plurality of units per the 



11 



respective portion." In this regard, the Examiner contends that "dividing the gradient by the 
maximum gradient in the entire image" of Acharya meets this element. Advisory Action, p. 5. 
Clearly, this is erroneous as dividing one number (i.e., the gradient) by another number (i.e., the 
maximum gradient) bears no resemblance to basing a threshold upon an amount of the plurality 
of units per the respective portion. For this further reason claim 27 is patentable over Acharya. 

E. Claims 28 and 29 Are Patentable Under 35 U.S.C §102(e) over Acharya 

Claim 28 depends from claim 27 and further recites that the first and second results 

"comprise a sum of absolute differences between the first portion and the first adjacent portion 
and the second portion and the second adjacent portion, respectively." The Examiner 
erroneously contends that Acharya meets this element by applying a mask to a pixel region to 
obtain a resulting differential. Advisory Action, p. 6 (citing Acharya, col. 6, Ins. 10-29). 
However neither this nor any other portion of Acharya discloses that the first and second results 
"comprise a sum of absolute differences." 

As disclosed in the present application, a sum of absolute differences takes "all units 24 
of one portion [which are] all are subtracted from all units 24 of an adjacent portion to arrive at a 
plurality of results, the absolute values of which are then added together. This is called the sum 
of absolute differences, or SAD." Specification, p. 6, Ins. 22-25. No such sum of absolute 
differences exists in Acharya, at least because the resulting differential of Acharya is not an 
absolute value. For this additional reason, claim 28 and claim 29 depending therefrom 
patentably distinguish over Acharya. 
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IX. CONCLUSION 



Since the rejections of the claims are baseless, they should be reversed. 

Respectfully submitted, 



Date: March 20, 2003 . 




Mark J. Rozman, Reg. No. 42,1 17 
TROP, PRUNER & HU, P C. 
8554 Katy Fwy, Ste 100 
Houston, TX 77024-1805 
512/418-9944 [Phone] 
713/468-8883 [Facsimile] 
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APPENDIX OF CLAIMS 

The claims on appeal are: 



1 1 . A method comprising: 

2 receiving a video frame; 

3 identifying noise in a first portion of the video frame; and 

4 replacing the first portion with a second portion of the video frame. 

1 2. The method of claim 1 , wherein identifying further comprises: 

2 associating a noise level with the first portion of the video frame; and 

3 comparing the noise level to a predetermined value. 

1 3. The method of claim 2, wherein associating further comprises 

2 distinguishing the first portion from the second portion. 

1 4. The method of claim 3, wherein distinguishing further comprises: 

2 associating a first value with the first portion; 

3 associating a second value with the second portion; and 

4 performing a plurality of arithmetic operations between the first value and the 

5 second value. 

1 5. The method of claim 4, wherein associating a first value with the first portion 

2 further comprises: 

3 identifying a plurality of values associated with the first portion; and 

4 performing an arithmetic operation on the plurality of values to render the first value. 

1 9. A system including: 

2 a bus; 

3 a processor coupled to the bus; 

4 a device coupled to the bus to receive a video signal; and 

5 a storage medium coupled to the bus including a software program that, upon execution: 

i 



6 detects noise in a first portion of a video frame of the video signal; and 

7 replaces a first portion of the video frame with a second portion of the video frame. 

1 10. The system of claim 9, wherein the video frame is stored in a memory and, upon 

2 execution, the software program writes to the memory to replace the first portion of the video 

3 frame. 

1 11. The system of claim 10, wherein, upon execution, the software program further 

2 detects noise by comparing a noise level associated with the first portion of the video frame with a 

3 predetermined value. 

1 12. The system of claim 1 1, wherein the predetermined value is stored in the memory. 

1 15. The system of claim 9, wherein the storage medium is a hard disk drive. 

1 16. An article comprising a medium storing instructions that cause a processor-based 

2 system to: 

3 locate a video frame of a video signal; 

4 identify noise in a first portion of the video frame; and 

5 replace the first portion with a second portion of the video frame. 

1 17. The article of claim 16, further storing instructions that cause the processor-based 

2 system to locate the video frame by reading a memory device. 

1 18. The article of claim 17, further storing instructions that cause the processor-based 

2 system to: 

3 associate a noise level with the first portion of the video frame; and 

4 compare the noise level to a predetermined value. 
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1 19. The article of claim 18, further storing instructions that cause the processor-based 

2 system to: 

3 associate a first value with the first portion; 

4 associate a second value with the second portion; and 

5 perform a plurality of arithmetic operations between the first value and the second value. 

1 20. The article of claim 19, further storing instructions that cause the processor-based 

2 system to: 

3 identify a plurality of values associated with the first portion; and 

4 perform an arithmetic operation on the plurality of values to render the first value. 

1 22. The article of claim 16, wherein the medium storing instructions is a memory 

2 device. 

1 25. A method comprising: 

2 receiving a video frame; 

3 analyzing a first portion of the video frame with a first adjacent portion of the video frame 

4 to obtain a first result; 

5 analyzing a second portion of the video frame with a second adjacent portion of the video 

6 frame to obtain a second result; and 

7 replacing the first portion of the video frame with one of the second portion, the first 

8 adjacent portion or the second adjacent portion if a comparison between the first result and the 

9 second result is indicative of noise. 

1 26. The method of claim 25, wherein each of the first and second portions and the first 

2 and second adjacent portions comprises a plurality of units, and wherein the analyzing is 

3 performed on a unit by unit basis. 
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1 27. The method of claim 26, further comprising calculating a first threshold based 

2 upon an amount of the plurality of units per the respective portion. 

1 28. The method of claim 27, wherein the first and second results comprise a sum of 

2 absolute differences between the first portion and the first adjacent portion and the second portion 

3 and the second adjacent portion, respectively. 

1 29. The method of claim 27, wherein the comparison is indicative of noise if a 

2 difference between the first result and the second result exceeds the first threshold. 

1 30. The method of claim 25, wherein the first portion comprises an edge portion of the 

2 video frame. 
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